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EVALUATION  OF  THE  SENSITIVITY  OF  BASELINE  MONITORING: 
MICROCOSM-FIELD  WATER  QUALITY  COMPARISONS 


By 

Raynond  W.  Alden  III* 

INTRODUCTION 

Environmental  impact  assessments  are  often  evaluated  by  comparing  con¬ 
ditions  prior  to  a  particular  activity  (baseline)  and  trend  assessment  stud¬ 
ies  during,  or  immediately  following  the  activity.  Therefore,  investigators 
should  be  concerned  as  to  whether  their  baseline  date  is  adequate  to  allow 
the  detection  of  impacts  during  such  studies.  In  order  to  address  this 
issue  properly,  several  influential  factors  must  be  considered.  These  are: 
the  spatial  and  temporal  variability  in  the  study  area;  the  intensification 
and  coverage  of  the  monitoring  regime;  and  the  sensitivity  and  "appropriate¬ 
ness"  of  the  statistical  models  to  be  employed  in  the  evaluation  of  the 
data. 

One  way  to  approach  the  concern  over  the  adequacy  of  a  monitoring  ef¬ 
fort  is  to  perform  a  sensitivity  evaluation  of  the  baseline  program  while  it 
is  still  in  progress.  The  evaluation  can  be  statistical,  producing  esti¬ 
mates  of  "Minimum  Detectable  Impacts"  for  different  models  (Alden,  1984). 
On  the  other  hand,  the  evaluation  may  be  empirical,  using  laboratory  and 
field  data  to  test  the  effectiveness  of  the  program.  This  report  describes 
the  evaluation  of  a  water  quality  monitoring  program  at  the  proposed  Norfolk 
Disposal  Site  (NOS)  using  data  from  a  laboratory  microcosm  study  to  provide 
a  hypothetical  "Impact." 

The  microcosm  experiment  was  designed  to  simulate  the  conditions 

♦Director,  Applied  Marine  Research  Laboratory,  Old  Dominion  Ufilversity, 
Norfolk,  Virginia. 


immediately  following  open  ocean  disposal  of  dredged  materials.  The  water 
quality  changes  from  this  experiment  were  evaluated  statistically  and  signi¬ 
ficant  changes  were  described  (Alden  et  al.,  1981).  The  question  posed  in 
the  present  report  is  whether  impacts  which  were  clearly  defined  under  lab¬ 
oratory  conditions  could  have  been  detected  if  they  had  been  observed  in  the 
context  of  the  natural  spatio-temporal  variability  of  the  monitoring  data 
from  the  field. 

METHODS  AND  MATERIALS 

The  water  quality  monitoring  program  at  the  NDS  has  been  previously 
described  (Alden  et  al.,  1982;  and  in  the  accompanying  report,  Alden  et  al., 
1984),  The  data  from  the  March,  April,  June,  August  and  October  1981  crui¬ 
ses,  were  evaluated  as  the  baseline  data  set  in  comparison  to  the  water 
quality  measurements  from  a  laboratory  microcosm  experiment  conducted  during 
the  Fall  of  1980.  The  experimental  "dump"  samples  from  the  microcosm  repre¬ 
sented  conditions  following  disposal  of  materials  dredged  from  the  most 
contaminated  portion  of  the  Southern  Branch  of  the  Elizabeth  River,  while 
the  control  samples  were  for  similar  disposal  conditions  using  reference 
sand  from  the  NDS.  A  full  discussion  of  the  statistical  treatment  of  the 
microcosm  water  quality  data  set  was  previously  described  (Alden  et  al., 
1981).  For  the  purposes  of  the  present  study,  the  data  from  20  "dump"  sam¬ 
ples  (representing  the  seasonal  NDS  samples)  and  16  "control"  samples  (rep¬ 
resenting  the  seasonal  samples  from  peripheral  sites)  were  randomly  selected 
to  represent  data  from  a  hypothetical  post-" Impact"  Fall  cruise.  The  data 
from  the  simulated  cruise  were  then  statistically  evaluated  by  a  series  of 
models  in  the  context  of  the  baseline  data  set. 

The  statistical  models  employed  In  the  baseline-microcosm  evaluation 


included  the  Principal  Components  Analysis  (PCA)  probability  ellipse  models 
described  by  Green  (1979);  discriminant  analyses  (Klecka  1975)  utilizing 
both  seasonal  and  annual  baseline  data  sets;  and  the  season-area  interaction 
MANOVA  model,  also  suggested  by  Green  (1979).  Each  of  these  statistical 
models  and  their  application  to  the  NOS  water  quality  data  set  are  detailed 
in  an  accompanying  report  (Alden,  1984). 

RESULTS  AND  DISCUSSION 

A  principal  components  analysis  was  conducted  on  the  entire  1981  water 
quality  data  set  and  probability  ellipses  were  calculated  for  standardized 
PCAscores.  New  PCA  scores  were  calculated  for  the  control  and  "dump"  data 
from  the  simulated  cruise  to  determine  whether  they  fell  significantly  out¬ 
side  of  baseline  conditions.  All  16  control  replicates  (not  shown  for  clar¬ 
ity  of  graphics)  fell  within  the  small  95it  confidence  ellipse,  while  the 
mean  "dump"  PCA  fell  outside  of  the  confidence  ellipse,  and  the  extreme  case 
was  outside  of  the  99%  probability  ellipse  (Fig.l).  Therefore,  the  method 
indicates  a  significant  "impact"  (e.g.  lower  D.O.  increased  nutrients)  has 
occurred  at  "dunp"  sites,  but  not  for  the  controls. 

The  second  approach  to  the  statistical  evaluation  of  the  scenario  em¬ 
ployed  discriminant  analysis.  The  first  run  combined  the  October  1981  data 
with  the  "control"  data  as  one  group  to  be  contrasted  to  the  "dump"  measure¬ 
ments.  The  analysis  indicated  a  very  significant  (p  <  0.0001)  discrimina¬ 
tion  between  the  groups,  primarily  due  to  elevated  nutrients,  and  lower 
oxygen  and  chlorophyll  levels  for  the  "dunp"  conditions  (Fig.  2).  The 
classification  of  the  cases  into  the  groups  was  lOOX  current,  further  con¬ 
firming  the  strength  of  the  model. 

The  second  discriminant  analysis  run  compared  the  entire  baseline  data 
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Figure  1.  Principal  components  model  for  trend  assessment.  The  small 
ellipse  is  the  95%  confidence  limits  of  the  standardized  PC. 
Scores  of  the  1981  water  quality  data  sets,  while  the  larger 
ellipse  represents  the  99%  probability  limits.  The  closed 
circle  Is  the  mean  of  the  "dump"  standardized  PC  scores  and 
the  star  Is  the  extreme  case.  (See  Table  1  for  abbreviations) 
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Discriminant  analysis  model  for  trend  assessment  with  100%  of  "grouped"  cases 
correctly  classified.  The  frequency  of  discriminant  scores  for  the  (a) 
October  1981  baseline  water  quality  data,  and  (b)  "dump"  data.  The  asterisks 
represent  group  centroids.  (See  Table  1  for  abbreviations). 


set  (including  control  readings)  to  the  "dimp"  data.  This  model  also  proved 
to  be  highly  significant  (p  <  0.0001)  and  the  classification  was  nearly  per¬ 
fect  (98.76%  correct)  (Fig.  3). 

The  final  statistical  model  was  a  MANOVA  model  designed  to  determine 
whether  a  significant  season-area  interaction  was  detectable.  In  the  model, 
data  from  the  October  1981  cruise  was  compared  to  the  simulated  data  for 
seasonal  effect,  since  the  microcosms  were  conducted  during  November  and  may 
be  seen  to  represent  a  successive  cruise  occurring  after  hypothetical  dis¬ 
posal  operations  have  commenced.  Once  the  cruise-to-cruise  water  quality 
differences  and  natural  spatial  patterns  have  been  mathematically  taken  into 
account,  an  interaction  term  was  tested  to  determine  whether  significant 
changes  were  occurring  at  the  disposal  site  following  the  "dump"  that  were 
not  also  taking  place  in  the  control  regions.  This  model  not  only  indicated 
whether  overall  changes  have  occurred  due  to  disposal  operations,  but  points 
out  which  parameters  were  significantly  affected.  The  interaction  term  was 
a  very  highly  significant  effect  (p  <  0.0001).  Chlorophyll  and  dissolved 
oxygen  were  significantly  depressed  in  the  "dump"  samples,  while  nutrients 
and  suspended  solids  were  elevated  (Table  1).  Although  the  magnitude  of 
change  appears  to  have  been  quite  high  (over  200%)  for  some  of  the  parame¬ 
ters,  most  of  these  were  found  at  extremely  low  levels  in  the  field.  There¬ 
fore,  the  absolute  concentrations,  though  significantly  different  from 
control  levels  were  still  moderately  low.  In  fact,  few  of  the  affected 
parameters  fell  outside  of  the  natural  range  reported  by  Kester  and  Courant 
(1973)  for  the  lower  Chesapeake  Bay  waters  and  none  even  approached 'the 
water  quality  criteria  or  "reference  levels"  recommended  by  State  and  Feder¬ 
al  agencies  for  the  protection  of  marine  life  or  the  prevention  of  eutro¬ 
phication  (VSWCB,  1976). 


TABLE  1:  Summary  of  results  of  MANOVA  model:  baseline  cruise  versus 
simulated  post-disposal  cruises. 


Seasonal 
Ch ange 


Dump  Site 
Interaction 


Magnitude  of  Interaction 
{%  Change  over  Control) 


D.O. 

+ 

★★★ 

D.O. 

+ 

- 

13  % 

TP 

+ 

TP 

+ 

+ 

100  % 

*** 

NO2 

NO2 

+ 

233  % 

★  ★★ 

NH3 

+ 

NH3 

+ 

+ 

49  % 

TKN 

+ 

TKN 

f 

+ 

50  % 

*** 

S.S. 

+ 

S.S. 

+ 

+ 

20  * 

★★★ 

Chi  or.  ^ 

+ 

Chi  or.  ji 

- 

39  % 

•kifk 

Chi  or.  ^ 

+ 

k-k-k 

Chi  or.  b 

+ 

- 

22  % 

Chi  or.  c 

+ 

k 

NO3 

+ 

116  % 

•kitit 

OPO4  ~ 

k 

pH 

_ 

0.55 

Note:  There  are  no  significant  differences  between  control  and  disposal 
site  data  under  baseline  conditions,  so  the  results  of  the  second 
main  effect  of  "station  location"  is  not  displayed. 

*  =  p<0.06;  **  =  p<0.01;  ***  =  p<0.001. 


Key  to  Abbreviations: 

0.0.  -  Dissolved  Oxygen 

Chi  or.  -  Chlorophyll 

NHj  -  Ammonia 

NO2  -  Nitrite 

NO3  _  Nitrate 

OPO4  _  Orthophosphates 

S.S  .  Suspended  Solids 

TP  _  Total  Phosphorus 

TKN  _  Total  Kjeldahl  Nitrogen 


Thus,  all  of  the  statistical  models  allowed  the  detection  of  a  statis¬ 
tically  significant  "impact"  at  a  level  below  that  which  may  be  of  acute 
ecological  significance.  This  is  the  desired  situation  if  the  trend  assess¬ 
ment  statistical  models  are  to  act  as  an  "early  warning  system"  for  the 
detection  of  an  impact  before  the  environment  deteriorates  excessively. 

CONCLUSIONS 

A  sensitivity  evaluation  was  conducted  on  the  water  quality  monitoring 
program  at  the  NOS  using  empirical  laboratory  microcosm  data  to  simulate  a 
hypothetical  impact.  The  three  types  of  statistical  models  used  to  compare 
baseline  and  "dump"  data  were  all  successful  at  detecting  differences  in 
water  quality,  despite  the  fact  that  the  absolute  concentrations  of  the 
"impacted"  samples  were  moderately  Tow.  Thus,  the  monitoring  regime  and 
statistical  models  developed  for  the  NDS  appear  to  provide  an  effective 
"early  warning  system"  for  major  water  quality  changes  which  may  be  associ¬ 
ated  with  disposal  activities.  Should  statistically  significant  effects  be 
consistently  detected  by  these  techniques  in  future  trend  assessment  studies 
after  the  NDS  becomes  active,  more  intensive  environmental  monitoring  inves¬ 
tigations  can  be  mounted  to  confirm  the  trend,  as  well  as  to  determine  the 
specific  cause  and  ecological  significance  of  the  impact.  Therefore,  the 
program  would  appear  to  provide  the  opportunity  for  intervention  prior  to 
excessive  environmental  impacts  to  the  region. 
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